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A METHOD SWITCHING THE VIDEO COMPONENT (S) 
OF A FIRST DIGITAL, AUDIO- VISUAL PROGRAM ONTO 
THE VIDEO COMPONENTS OF A SECOND DIGITAL, VIDEO-AUDIO PROGRAM 
TO COMPENSATE THEIR PHASE SHIFT. 

[001] The present invention relates to a method switching the video 

component (s) of a first digital, audio-visual program onto the video 
component (s) of a second digital, audio-visual program. 

[002] The invention applies to the field of digital, audio-visual 

services wherein digital programs consist of at least one video 
component and may comprise several video components, none or several 
audio components, and none or several data components. The invention 
only considers the case of video components. 

[003] Pertinent digital audio-visual services include those using 

the so-called MPEG-2 standard (Moving Pictures Expert Group) ISO/IEC 
JTC1 IS 13818. This standard is described in several documents each 
corresponding to a distinct portion (video, audio, system, conformity 
etc . ) 

[004] Nevertheless it is to be understood that the present 

invention is not restricted to solely following this particular MPEG-2 
standard but also covers any digital, audio-visual service application. 



[005] The audio and video portions of the MPEG-2 standard described 

how to digitally code the audio and video data. The system portion of 
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the MPEG-2 standard specifies that resultant compressed elementary 
streams are configured as elementary stream packets termed packetized 
elementary streams (PES) packets containing video data. These PES 
packets may be of fixed or variable size. 

[006] In non restrictive manner the description below discusses the 

use of variable-size, video PES packets , each PES packet containing a 
single picture and where called for sequence headers or headers of group 
of pictures GOP, the pictures being aligned at the beginning of the PES 
packet. The PES packets moving the same elementary stream are 
identified by a stream identifier called the stream Id. 

[007] The system MPEG-2 standard indicates that the PES packets 

(video, audio or data) may be multiplexed for local use for instance 
with signalization PES packets. Such a multiplex may be stored in the 
kind of disks known as DVD (digital versatile disk) for instance if a 
program MPEG-2 syntax is involved. 

[008] According to the system MPEG-2 standard, the elementary 

stream configured as PES packets next may be cut into fixed-size packets 
called transport packets (TP) . Such a fixed-size packet is identified 
by a packet identifier (PID). A stream of PES packets having the same 
stream ID can only be moved in transport packets having the same packet 
identifier PID. The transport packets moving a particular elementary 
stream (and the PES packets having divided- this elementary stream a 
first time) can be multiplexed with other transport packets TP moving 
other elementary streams, and furthermore also including transport 
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packets TP containing the signalization. These multiplexes of transport 
packets TP then are available for transmission: it involves the 
transport MPEG-2 syntax. 

[009] The system portion of MPEG-2 therefore relates to two 

syntaxes, the MPEG-2 program syntax and the MPEG-2 transport syntax. 
The MPEG-2 system syntax is generic in the sense that these two syntaxes 
can be converted one into the other and in that they apply to two very 
different applications : storing an MPEG-2 program and transmitting one 
or more MPEG-2 transport programs. One of the applications of the 
invention relates to these to syntaxes. 

[010] The video portion of the video MPEG-2 standard relates to 

three kinds of pictures: 

— the so-called I pictures (intra coded) that do not refer 
to any other picture; these are the pictures with a moderate 
compression ratio; their coding does not entail using 
procedures of motion estimates, 

— the P pictures (predictive coded pictures) which are coded 
pictures using prediction procedures estimating motion based 
on a preceding picture which may be a type I or a type P 
picture, 

— the B pictures (bidirectional predictive-coded pictures) 
which are coded using prediction procedures of motion 
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estimates based on a preceding picture (as regards display, 
it is called forward prediction) and/or a future picture (as 
regards display, this is a back prediction) which are of the 
I or P type. 

[Oil] The video MPEG-2 standard sets up six hierarchy levels for 

the syntax of an elementary video stream: the sequence, the group of 
pictures GOP which is the only optional level, the picture (type I, P 
or B) , the picture slice, the macroblock and the block. 

[012] A video sequence begins with a sequence header which is 

followed by one or more sets of pictures. According to the MPEG-2 
standard, these sets of pictures may be configured in (optional) groups 
of pictures GOP. A group of pictures GOP is characterized by a header 
of group of pictures GOP situated before the pictures. In the order of 
transmission, a group of pictures GOP begins with a (mandatory) I 
picture followed in a rigorous order by a certain number of 
bidirectional B pictures and predictive P pictures. 

[013] The conventional size of the group of pictures GOP being 12 

pictures, the program video component consists of strings of sequences 
at one group of pictures GOP per sequence. In loose manner hereafter, 
a group of pictures GOP shall be called a sequence header followed by 
a 12-picture group of pictures GOP or by several smaller groups of 
pictures GOP. 
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[014] The pictures comprise a header and data consisting of a 

certain number of slices. One slice reconfigures several continuous 
macroblocks in the picture. In conventional (4:2;0 format) digital 
television, a macroblock is the combination of four luminance blocks, 
one block with a first chrominance component for the same pixels and 
one block of a second chrominance component also for the same pixels. 
One block contains the data of eight by eight squares of pixels. 

[015] The illustrative application of the invention described 

further below remains within the scope of the MPEG-2 transport standard. 
This implementation relates to chaining different television programs. 
A first program selected from a given number of programs of a first 
multiplex is to be switched onto a second program selected from a given 
number of programs from a second multiplex and, as called for later, to 
switch again the second program onto the first one. 

[016] These operations involve two same-syntax multiplexes (for 

instance MPEG-2 transport syntax or MPEG-2 program syntax) which are 
coded in real time or are retrieved from a storage system. The 
illustrative implementation of the invention described further below 
relates to the transport MPEG-2 but operations carried out at the 
elementary level and at the level of the PES packets are directly 
applicable to the program MPEG-2 standard. 

[017] In particular reference is made to the patent document WO 98 

32 281 A which describes a switching method based on compressed digital 
stream data such as the MPEG transport streams . In particular the 
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streams implemented in the invention described in said patent document 
are fitted with at least one stream entry point and at least one exit 
point identifying an appropriate exit point of this stream. Accordingly 
a main stream is switched at its output point onto the entry point of 
another stream. Furthermore an exit point of a video stream in general 
is the end of the last video transport packet of the stream. As regards 
the entry point, it is generally the beginning of the first transport 
packet of the stream under consideration. A stream between an entry 
point and an exit point is called a segment of which the first picture 
is a fixed picture and the second picture does not refer to a picture 

: j before the entry point. Also, the last segment picture in the order of 

i'j* presentation cannot be a B picture. 

sj [018] It is understood in the light of the above that by 

rn appropriately selecting the input and output points, a main stream can 

|'~f be switched onto a segment and that this switching is carried out 
without a visible defect appearing in the presented picture. 

[019] Nevertheless, as already cited in the above cited patent 

document, commercial television may deliberately generate streams 
lacking exit points, so that switching based on these streams must 
entail defects. Also someone using such a system must be able to 
control the source of the stream to which the switching is applied in 
order to meet the above constraints: entry point, first and second 
pictures, last picture. The applications cited in the above patent 
document are all carried out in a studio which therefore controls the 

AMENDED SHEET 
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stream which shall be switched. In some applications, however, for 
instance at the head of a radio station, such may not be the case 
because the two sources are part of the television production channels. 

[020] Moreover there are few manufacturers of the MPEG-2 coders who 

offer means implementing these entry and exit points. 

[021] This kind of application raises a major problem in that the 

video components, being switched one onto the other will not be 
necessarily synchronized. If not synchronized, they exhibit a phase 
difference due to processes taking place at different levels: 

— still at the elementary video level: the video scenes 
compressed by each video coder may exhibit different 
structures (picture sizes, structures of the groups of 
pictures, etc. ) , 

— regarding the PES packets: the packaging mode of the 
compressed pictures in the PES packets may differ from one 
component to the next, 

— as regards the transport packets TP: the advance or delay 
caused by the jitter of the transport packets within which 
the PES packets are being moved. 



AMENDED SHEET 
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[022] Within the scope of the present invention, the phase 

differences at the elementary level assume foremost importance. As 
regards the PES packets, it will suffice to handle the case of one PES 
packet containing a single picture. On the other hand the jitter of the 
transport packets is ignored. 

[023] Given the phase shift of the video coders, the end of a 

sequence or of a group of pictures GOP of the first program may be 
located anywhere in the video of the second program, for instance in the 
progress of an arbitrary picture. Therefore the next beginning picture 
may be a bidirectional B picture or a predictive P picture which refer 
to other pictures of the second program preceding switching and which 
were not transmitted because at that time the transmission did apply to 
the first program pictures. The result is improper decoding and defects 
in the displayed pictures that may last more or less depending on the 
magnitude of the phase difference between the two video components . 

[024] In order to compensate this phase difference, one simple 

solution would be to delay the second program, entailing a storage 
having the capacity of a group of pictures GOP for each second-program 
video component. However this solution entails applying a permanent 
delay to the second program. Also this solution will be difficult to 
apply if the second program is scrambled. 
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[025] Therefore the objective 

propose a method allowing solving 
problem and precluding delaying the 
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of the present invention is to 
the above cited phase difference 
second program. 



[026] For that purpose a method of the invention switching the 

video component (s) of a first digital, audio-visual program onto the 
video component (s) of a second, digital audio-visual program is 
characterized in that the switching takes place after the command to 
switch onto the second-program video component and after the end of a 
picture of the first program and in replacing, in the order of 
transmission, each picture other than an Intra picture of said 
component of said second program with a picture which is coded 
independently of the picture data of the replaced picture and of the 
contents of the pictures to which it refers until the beginning of the 
next Intra picture of said component of the said second program. 

[027] In another feature of the invention, its method consists in 

replacing the data present in the second-program video component between 
the time when the end of a picture of the first-program video component 
has been encountered after having received the switch command and the 
beginning of the first picture of the second program with stuffing data. 



[028] In another feature of the invention, the time references of 

each replacement picture are updated. 
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[029] I another feature of the invention, the data relating to the 

expected minimum delay before it is feasible to decode a picture (Vbv 
delay) is retrieved from the replaced picture and positioned in each 
corresponding replacement picture unless it be different from ' FFFF in 
the other pictures of said component of said second program and in this 
case assuming the value 'FFFF. 

[030] In a first implementation variation of the method of the 

invention, the replacement pictures constitute a sequence of 
bidirectional B pictures all referring to the last predictive picture 
P of the first-program video component, the motion estimating vectors 
of each bidirectional substitution picture B being set to a zero value. 
Said replacement pictures B for instance are interleaved pictures 
comprising a BOTTOM frame and a TOP frame which as a result are similar 
to digital television pictures and their predictions are field-based 
predictions. In this case the TOP frames and the BOTTOM frames of said 
B replacement pictures refer to the sole BOTTOM frame of the last 
predictive P picture of the first-program video component. 

[031] In a second variation of implementation of the method of the 

invention, the replacement pictures constitute a sequence of pictures 
which, in the order of transmission, are a predictive picture followed 
by one or more bidirectional pictures, the predictive replacement 
picture P referring to the last predictive picture P of the first- 
program video component and each of the bidirectional B pictures 
referring to said predictive replacement picture P, the motion 
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estimating vectors of each of the substitution pictures being set to a 
zero value. 



[032] In another mode of implementing the method of the present 

invention, the replacement pictures constitute a sequence of pictures 
which, in the order of transmission, consists alternating predictive and 
bidirectional pictures, the first predictive replacement picture 
referring to the last predictive picture P or I picture of the first- 
program video component, then each following replacement predictive 
picture P referring to the predictive P picture preceding it, and each 
bidirectional replacement picture B only referring to the predictive P 
picture which precedes it, the number of bidirectional B pictures 
between two predictive P pictures being equal to the number encountered 
in the first-program video component, and motion estimating vectors of 
each of the replacement pictures being set to a zero value. 

[033] In either of the above cases, said replacement pictures are 

frame pictures comprising a TOP frame and a BOTTOM frame which as a 
result are similar to digital television pictures and their predictions 
are field-based predictions. Therefore the TOP and BOTTOM frames of the 
first predictive replacement picture P refer to the sole BOTTOM frame 
of the last predictive picture P or I of the first-program video 
component, and the TOP and BOTTOM frames of the predicted P or 
bidirectional B pictures which follow refer to the BOTTOM frame of the 
first predictive replacement picture P. 



.... » 
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[034] In another implementing mode of the method of the present 

invention, the replacement pictures constitute a sequence of pictures 
which, in the order of transmission, consists of a first picture which 
is an Intra picture, the other pictures being alternating bidirectional 
and predictive pictures, the first predictive replacement picture P 
referring to the Intra picture, then each following predictive 
replacement picture P referring to the predictive picture P which 
precedes it, and each bidirectional replacement picture B only referring 
to the predictive picture P or Intra picture which precedes it, the 
number of bidirectional pictures B between two predictive pictures P 
being equal to that encountered in the first-program video component, 
and the motion estimating vectors of each of the replacement pictures 
being set to a zero valueexcept for the Intra picture which is without 
a motion estimating vector. Said replacement pictures are frame 
pictures which may comprise a TOP frame and a BOTTOM frame which as a 
result are pictures similar to those of digital television and the 
predictions of the bidirectional pictures B and the predictive pictures 
P are field-based predictions. The TOP and the BOTTOM frames of the 
replacement pictures B or P which follow the picture I then refer to the 
BOTTOM frame of the replacement picture I or P which precedes it. 

[035] The method of the present invention can be implemented in a 

transmission system wherein said pictures each constituting video 
components of the first and second programs are transported by transport 
packet streams, each transport... packet TP being fitted with a PUSI 

(payload unit start indicator) indicator which, when set at 1, denotes 
that said packet contains the beginning of a PES (packetized elementary 
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stream) packet, the PES packets being aligned with the beginning of 
payload of the transport packets TP, each PES packet containing a single 
picture, said transport system being such that certain transport packets 
are made to carry transport data such as a random access indicator ( RAI ) 
which, when set at 1, denotes that the next transport packet moving this 
component shall contain the first data of a video sequence. In this 
case said system consists in the following: 

— determining the first transport packet TP of the first- 
program video component which is present after the switch 
command and which comprises a random access indicator RAI set 
at 1 in order to determine the time of switching at the 
second program, 

— switching onto said second-program video component and 
replacing the transport packets TP of this video component 
with stuffing transport packets until the appearance of the 
following transport packet TP of which the PUSI indicator is 
set at 1, 

— in this transport packet TP, of which the PUSI indicator 
is set at 1, and provided the RAI indicator is NOT set, 
replacing the PES packet header situated at the beginning of 
the payload by a reconstructed PES packet header, 

— starting with this transport packet and after the PES 
packet header, replacing the payload data of each transport 



i!fl 
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packet of this component with the replacement picture data 
and when all data of the replacement picture have been 
inserted into the video component transport packet payloads, 
replacing the payload data of following transport packets TP 
of the component with video stuffing such as ' 00 octets until 
the appearance of the next transport packet of this second- 
program video component of which the PUSI indicator is set 
at 1, this transport packet TP excluded, 

— then restarting the preceding stage from this transport 
packet TP with the PUSI indicator set at 1 until the 
appearance of the next transport packet of the second-program 
video component of which the random access indicator RAI is 
set at 1, this transport packet excluded, 

-- setting the discontinuity indicator DI at 1 on this packet with 
the random access indicator RAI which corresponds to the end of 
replacement and to the actual beginning of the second program 
video . 



[036] Advantageously, if the transport packets TP are scrambled, 

said method consists in denoting them in clear by setting the transport 
scrambling control TSC field at the binary value 00. 

[037] Said method can be implemented in a transmission system 

wherein said pictures each constituting video components of the first 
and second programs are transported by transport packet streams, each 
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transport packet TP comprising a PUSI indicator which, when set at 1, 
denotes that said packet contains the beginning of a PES packet, these 
PES packets being aligned with the beginning of the payload of the 
transport packets TP, each PES packet containing a single picture, said 
transmission system consisting in he following: certain transport 
packets are intended to carry transport data such as a random access 
indicator RAI which, when set at 1, denotes that the next transport 
packet moving this component contains the first data of a video 
sequence, said method then consisting in: 

— determining the first transport packet of the first- 
program video component which is present after the switch 
command and which comprises a random access indicator RAI set 
at 1 to determine the switching time onto the second program, 

— switching onto said second-program video component and 
replacing the transport packets TP of this video component 
with stuffing transport packets until the appearance of the 
following transport packet TP of which the PUSI indicator is 
set at 1, 

if the RAI indicator is set and starting with this 
transport packet and after the PES header, replacing the 
payload data of each transport packet of this component with 
replacement image data and when all replacement image data 
have been inserted in the payload of the video component 
transport packets TP, replacing the payload data of the 



16 4444-020 
following transport packets TP of the component with video 
stuffing such as '00 octets until the appearance of the next 
transport packet of this second-program video component of 
which the PUSI indicator is set at 1, this TP transport 
packet excluded, 

— then beginning again with the previous stage based on this 
transport packet TP with the PUSI indicator set at 1 until 
the appearance of the next transport packet TP of the second- 
program video component of which the random access indicator 
RAI is set at 1, this transport packet excluded, 

— setting the discontinuity indicator DI at 1 on this packet 
with random access indicator RAI which corresponds to the end 
of replacement and to the actual beginning of the second 
program video. 

[038] In case neither of the video components is fitted with a 

random access indicator RAI set in the transport stream, said method of 
the invention moreover consists in: 

— determining the video component transport packet TP of the 
stream (s) without RAI indicator of which the PUSI indicator 
is set at 1 and of which the payload data begin with a video 
sequence header, 
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— carrying out a search for the sequence header after the 
switch command, 

i 

setting the discontinuity index in the determined 
transport packet TP if latter comprises an adaptation field 
AF with a program clock reference PCR in the case of the 
component bearing the program clock, 

— or if the determined transport packet TP does not comprise 
an adaptation field AF or if the component bearing the 
program clock is involved and the adaptation field AF does 
not comprise a PCR clock reference, replacing the determined 
transport packet TP with a specific transport packet TP 
called the inserted transport packet and shifting the 
replaced transport packet TP as well as the following 
transport packets of this video component in the transport 
stream until one of them can be inserted into a stuffing 
transport packet TP. 

[039] Advantageously the inserted transport packet TP exhibits the 

following advantages : 

— the PUSI indicator is set at 0, 

— the status of the continuity counter COP is set at that 
of the continuity counter of the initial transport packet, 
less 1, 



■■■ • 
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— the control field AFC of the adaptation field AF is set 
at the binary value 00 denoting that an adaptation field AF, 
but not a payload, is present in this transport packet TP, 

— the discontinuity indicator DI situated in the adaptation 
field AF is set at 1, 

— if the video component carries the program clock reference 
PCR, set a PCR clock calculated on the basis of the preceding 
PCR clocks of the same component in the adaptation field AF. 

[040] In case a presentation time stamp PTS is present in the 

header of the PES packet containing the sequence header, the method of 
the invention pre-processes the setting of the RAI indicator, said 
transport packet TP which was inserted to set the random access 
indicator then exhibiting the following features: 

— the PUSI indicator is set at 0, 

— the status of the discontinuity counter COMP is set to 
that of the discontinuity counter of the initial transport 
packet TP less 1, 

— the control field AFC of the adaptation field AF is set 
to the binary value 10 denoting thereby that an adaptation 
field is present in this transport packet TP, but not a 
payload, 
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— the RAI indicator situated in the adaptation field AF is 
set at 1, 



the discontinuity indicator DI situated in the adaptation 
field is set, 

— if the video component carries the program clock, a 
program clock reference PCR calculated on the basis of the * 
preceding clock reference (s) PCR of the same component is set 
in the adaptation field AF. 

[041] In case the presentation stamp is absent from the header of 

the PES packet containing the sequence header and if the initial 
transport packet is modified in a manner that its PUSI indicator is set 
at 0 and payload data are suppressed in the PES packet header, then said 
transport packet TP inserted to set the RAI indicator will exhibit the 
following characteristics : 

-- the PUSI indicator is set at 1, 

— the status of the continuity counter COMP is set at that 
of the continuity counter of the initial transport packet TP, 
less 1, 

-- the control field AFC of the adaptation field AF is set 
at the binary value 11, denoting that an adaptation field and 
a payload are present in this transport packet, 
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— the adaptation field AF comprises an RAI indicator set at 1, 

— the discontinuity indicator is set at 1 on this packet 
with RAI indicator, 

— a program clock reference PGR calculated on the basis of 
the preceding clock reference (s) PCR of the same component 
is set in the adaptation field AF if the video component 
bears the program clock, 

— a presentation stamp PTS is calculated and positioned in 
this packet's payload, 

— the PES packet header in the replaced transport packet TP 
is moved into the payload of this inserted transport packet 
TP and in case the presentation stamp PTS is absent from the 
PES packet header, said stamp PTS is calculated and 
positioned in the header data of this PES packet. 

[042] The above cited features of the invention as well as further 

ones are elucidated below in the following description of several 
implementing modes of the invention, said description relating to the 
attached drawings also. 



[043] Fig. 1 is a view illustrating a switching method of a first 

implementing mode of the invention, 
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[044] Fig. 2 illustrates a switching procedure of a second 

implementing mode of the invention, 



[045] Fig. 3 illustrates a switching procedure of a third 

implementing mode of the invention, 

[046] Fig. 4 illustrates a switching procedure of a fourth 

implementing mode of the invention, 

[047] Fig. 5 illustrates a switching procedure of the first 

1 N 

implementing mode of Fig. 1 wherein the pictures comprise a top and a 
bottom frame , 

[048] Fig. 6 illustrates a switching procedure of the second 

implementing mode of Fig. 3 wherein the pictures comprise a top and a 
bottom frame , 

[049] Fig. 7 illustrates a switching procedure of the implementing 

mode of Fig. 3 wherein the pictures comprise a top and a bottom frame, 

[050] Fig. 8 illustrates a switching procedure of the implementing 

mode of Fig. 4 wherein the pictures comprise a top and a bottom frame, 



[051] Fig. 9 illustrates a switching procedure of the invention in 

the transport mode , and 
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[052] Figs. 10a - 10c illustrate the insertions of a transport 

packet fitted with an RAI indicator set at 1. 

[053] In the illustrative implementation now being described, the 

structure of the groups of pictures GOP of the two video streams under 
consideration and generally characterized by a gap between two P 
pictures (the M parameter in the MPEG-2 standard) and by a gap between 
two I pictures (called the N parameter in the MPEG-2 standard) is such 
that the parameter when being 2 denotes a single bidirectional picture 
B being placed between two consecutive predictive pictures P. As 
regards the N parameter, its value is arbitrary, the number of pictures 
in a group of pictures GOP being immaterial in the invention. 

[054] It must, be borne in mind that each program may comprise 

several video components, for instance components which correspond to 
different fields of view of the program (several cameras for instance) . 
The invention applies to each component, but for the sake of simplicity, 
herebelow, the description shall relate to a single video component for 
each program. 

[055] Fig. 1 shows an elementary video stream Fl of a first program 

and an elementary video stream F2 of a second program. Each stream Fl, 
F2 consists of a sequence of groups of pictures GOP comprising Intra I 
pictures, bidirectional B pictures and predictive P pictures. These 
pictures are shown in the order of their transmissions. 
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[056] Fig. 1 shows that the PES packets and the transport packets 

are absent from the implementation. 

[057] The switch command is shown by the arrow A and occurs during 

the group of pictures GOP1. This group of pictures GOP1 is the last 
transmitted group of pictures of the first-program video component. 

[058] In one illustrative mode of implementation of the invention, 

the group of pictures GOP1 must end before switching the video component 
of the stream Fl onto the video component of the stream F2 . This 
switching is indicated by an arrow B in Fig. 1. In this Figure, the 
group of pictures GOP2 is the first group of pictures of the second- 
program video component that shall be transmitted after switching. 

[059] According to the invention, switching onto the second-program 

video component takes place at the above defined time (arrow B) and then 
each picture of this component is replaced by a picture of which the 
coding is implemented independently of the picture data of the replaced 
picture and of the contents of its related pictures until the beginning 
of the next group of pictures of said second program component. These 
replacements take place for each picture of the incomplete group GOPs . 
They are denoted by the vertical arrows between the replacement pictures 
and the replaced pictures. 

[060] In Fig. 1, the switching onto the second-program video 

component takes place after the last picture of the group of pictures 
of the first component video component which was transmitted after the 
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switch command. The data present in the second-program video component 
between the end of the group of pictures GOP1 and the beginning of the 
first picture are replaced by stuffing data (denoted b in Fig. 1) . 
Depending on the case, these stuffing data may be those in the video 
syntax, those in the PES packet syntax or those in the transport syntax. 

[061] Illustratively and according to an implementation mode of the 

MPEG-2 transport standard, those will be stuffing transport packets. 
The replacement pictures of the incomplete group of pictures GOP of the 
second program are denoted group of pictures GOPs. As shown by Fig. 1, 
the group of pictures GOPs consists of a sequence of bidirectional B 
pictures all referring to the last P (or I) type picture of the last 
group of pictures GOP1 of the first program (in Fig. 1, arrows represent 
this reference) . These are forward references in the order of 
presentation. Moreover, the motion estimating vectors of each of the 
replacement pictures B are set to a zero value, making it possible to 
freeze the last P or I picture of the first program. 

[062] In Fig. 2, the replacement group GOPs consists of a picture 

P followed by a sequence of B pictures, where these bidirectional B 
pictures refer to said picture P. As regards the predictive P picture 
of the group GOPs, it refers to last P (or I) picture of the last group 
of pictures GOP1 of the first-program video component (forward reference 
in the order of presentation) . Also, the motion estimating vectors of 
each of the predictive P pictures or bidirectional replacement pictures 
B are set to a zero value, making it possible to freeze the last P or 
I picture of the first program. 
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[063] In this second implementing mode, the presence of the 

replacement picture P allows avoiding an unpleasant effect otherwise 
taking place at the end of replacement where interleaved pictures are 
concerned. 

[064] In Fig. 3 the replacement group GOPs consists of a sequence 

of alternating P or B pictures. The first replacement picture P relates 
to the last P or I picture of the last group of pictures GOP1 of the 
first-program video component. Each ensuing replacement picture P 
refers to the P picture which precedes it. Each replacement picture B 
refers to the P picture immediately preceding it. Therefore each P or 
B picture refers forward in the order of presentation. Also the motion 
estimating vectors of each of the replacement pictures P or B are set 
to a zero value, making it possible to freeze the last P or I picture 
of the first program. 

[065] In Fig. 4, the replaced group GOPs consists of a sequence of 

pictures of which the first is an I picture, the second a B picture, the 
third a P picture, the fourth a B picture, etc. The first replacement 
P picture refers to the replacement picture I. Each following 
replacement picture P refers to the replacement picture P which precedes 
it. Each replacement picture B refers to the replacement picture P 
immediately preceding it. Each P or B picture therefore constitutes a 
forward reference in the order of presentation. Furthermore the motion 
estimating vectors of each replacement picture P or B are set to a zero 
value, making it possible to freeze the replacement I picture. 
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[066] This fourth implementing mode allows inserting advertizing 

spots framed by fixed pictures, for instance colored pictures or logos. 



[067] The present invention also applies to systems supporting 

interleaved pictures. This is the case for the systems under the MPEG-2 
standard. In such systems, each picture comprises two frames, a TOP 
frame and a BOTTOM frame. ' The prediction of the macroblocks of these 
two frames may be frame-based or field-based. For perfect control and 
in order to avert "going backward", the prediction must be field based 
for each frame . 

[068] In the implementing mode shown in Fig. 5 and corresponding 

to the implementation of Fig. 1, the BOTTOM and TOP frames of each 
replacement bidirectional B picture refer to a single frame of the 
predictive P picture of the first program group of pictures GOP1 . In 
Fig. 1, this frame is the BOTTOM frame. , However it may also be the TOP 
frame . 

[069] Accordingly the frame of the P picture of the group of 

pictures GOP1 of the first program is maintained by the two BOTTOM and 
TOP frames of the replacement B pictures of the group of pictures GOPs . 
This implementation entails a drawback in the case of interleaved 
pictures: the P picture is displayed after the replacement pictures B 
as seen in the order of presentation. As a result, the impression of 
an advance is given at the end of the freeze because of the display of 
the BOTTOM frame of the P picture of the first program group of pictures 
GOP1. If the video is sluggish, this phenomenon will not be bothersome. 
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[070] In the illustrative implementation of Fig. 6, corresponding 

to the implementation of Fig. 2, the two TOP and BOTTOM frames of the 
replacement picture P of the replacement group of pictures GOPs refer 
to a single frame of the picture P of the group of pictures GOP1 of the 
first program. Advantageously this frame shall be the BOTTOM frame. 
As regards the following picture B, its BOTTOM and TOP frames each refer 
to the BOTTOM frame of the P picture preceding it. The BOTTOM and TOP 
frames of each replacement picture B of the group of pictures GOPs 
maintain the BOTTOM frame of the substitution picture P. 

[071] This implementing mode allows attaining a perfect freeze from 

which any visual defect is excluded using interleaved pictures. However 
one drawback is the difficulty in updating the time reference of the 
replacement picture P. 

[072] In the implementing mode of Fig. 7 corresponding to the 

implementation of Fig. 3, the two TOP and BOTTOM frames of the first 
replacement picture P of the group of pictures GOPs refer to a single 
frame of the predictive picture P of the first program group of pictures 
GOP1. Advantageously this frame shall be the BOTTOM frame. The BOTTOM 
and TOP frames of each P picture and of each B picture of the 
replacement group of pictures GOPs refer to the single BOTTOM frame of 
the P picture which precedes it . 

[073] This implementing mode allows perfect freezing without any 

visual defects using interleaved pictures and updating the time 
reference entails no problems. 
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[074] In the implementing mode of Fig. 8 corresponding to the 

implementation of Fig. 4, the TOP and BOTTOM frames of each P picture 
and of each B picture of the group of pictures GOPs refer to the single 
BOTTOM frame of the I or P picture which directly precedes it as seen 
in the order of transmission. 

[075] This mode of implementation allows perfect freezing without 

any visual defects with interleaved pictures and updating the time 
reference will not entail any problems. 

[07 6] The above cited references are carried out by setting the 

particular indicators in the macroblocks of the particular replacement 
pictures. All replacement picture macroblocks are coded to avert 
default-referencing the frames on the frame of the same parity (TOP on 
TOP and BOTTOM on BOTTOM) and dissociating each one's prediction. 

[077] Furthermore the picture patterns of the replacement group of 

pictures GOPs all must exhibit the same characteristics (resolution, 
or horizontal a vertical sizes in particular) as the pictures they 
replace. A number of means are available to retrieve the size 
information: it may be retrieved from the target background grid 
descriptor (if any) in the program map table, and it may be retrieved 
directly from the data of the video elementary stream etc. 



[078] Also, the time reference (order of the pictures to be 

displayed) of each replacement picture must be updated. 



29 4444-020 
[079] Lastly and to follow the standard, the VbV delay which is the 

least wait before it is possible to code a picture once the first 
picture octet has reached the decoder f s buffer memory, is defined as 
follows : 

— if said delay is situated in the other pictures of the 
group of pictures GOP2, it also must be situated the pictures 
of the replacement group: it may be retrieved from the 
replaced picture, 

— if the delay is at ' FFFF in the other pictures of the 
group of pictures GOP2, it must also be set at ' FFFF in the 
pictures of the replacement group. 

[080] As cited above, according to the MPEG-2 standard, the 

elementary stream packets PES comprise a header h and a payload with the 
data of a portion of one picture, of one picture or of several pictures 
(in general one picture) and are cut into transport packets TP. In case 
the payload of a PES packet contains the data of a single picture, the 
PES packets are aligned and the corresponding data alignment indicator 
is set at 1 . 

[081] Again according to the MPEG-2 standard, the transport packets 

of which the payload begins with the header h of a PES packet contain 
in their actual header H a specialized PUSI (payload unit start) 
indicator: this PUSI indicator is set at 1. Therefore transport packets 
of which the PUSI indicator is set at 1 contain the first data relating 
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to a particular picture (this also is the case for the TP2 , TP3 and TPS 
packets of Fig. 9). 



[082] Other transport packets intended to carry transport 

information contain an adaptation field AF. In this adaptation field 
AF, a random access indicator RAI indicates, when set at 1 (for example 
in the transport packet TP1 or the packet TP4 of Fig. 9), that the next 
transport packet of which the PUSI indicator is set at 1 (resp. here the 
transport packet TP2 and the packet TP5) , contains not only a beginning 
of a PES packet but also a beginning of a video sequence in the PES 
packet . 

[083] Be it noted that the transport packet TP of which the PUSI 

indicator is set at 1 may be the one of which the random access 
indicator RAI also is set at 1. 

[084] The adaptation field furthermore contains a discontinuity 

indicator DI which, when set at 1, indicates discontinuity starting with 
the transport packet TP, namely discontinuity of the continuity counter 
or discontinuity of the PCR clock reference if the component carries the 
PCR clock references. 

[085] Therefore two streams of transport packets are available in 

the invention (Fig. 9) . The first transport stream Ftl relates to the 
transport packets of the first program and the second transport stream 
Ft2 relates to the transport packets of the second program. 
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[086] Fig. 9 only shows those packets which move the video 

components of the programs under consideration. The transport packets 
of which the packet indicator PID differs and which are typically 
interposed were deliberately omitted for the sake of clarity. 

[087] Switching one video program onto another in the transport 

mode mainly consists in replacing the transport packets TP of the first- 
program video component with the transport packets TP of the second- 
program video component, if necessary accompanied by re-stamping. 

[088] Following the switch command (denoted by the arrow A in Fig. 

9), the end of the sequence (of the group of pictures GOP1) in the first 
program must be awaited. The next transport packet in the transport 
stream Ftl of the first program of which the random access indicator RAI 
is set at 1 (in this instance the transport packet TP1), will determine 
the time of switching onto the second program. 

[089] From that time on, the transport packets TP of the first- 

program video component are replaced with stuffing transport packets TP 

(denoted »b» in Fig. 9) until the appearance of the PUSI indicator of 
a transport packet TP of the transport stream Ft2 of the second program 
be set at 1. when such a packet denoting an image beginning in the 
stream Ft2 presents itself (in this example the TP3 packet), replacement 
may begin. This replacement will continue until the appearance of a 
packet, in this case TP4, shall appear in the transport stream Ft2, the 
header of said packet containing an RAI indicator be set at 1 denoting 
a beginning of sequence (in this case a group of pictures GOP2) . 
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[090] The procedure replacing a picture of the transport stream Ft2 

of the second program with a replacement picture is as follows: 

the PES packet header situated at the beginning of the 
payload is replaced in the transport packet TP of which the 
PUSI indicator is set at 1 with a header of a reconstructed 
PES packet; in an advantageous embodiment mode, the various 
fields of this header assume the following values: start code 
= 0x000001, flux stream indicator = that of the first 
program, PES packet length = 0x0000, 2 flag octets = 0x8500, 
header data length = 0x00, PES packets in clear, no PTS/DTS 
stamps nor any other data of PES packet header, 

— beginning with this transport packet (after the PES packet 
header) , the data of the payload of each transport packet of 
this component shall be replaced by the data of replacement 
picture (Intra picture I, bidirectional picture B or 
predictive picture P depending on the replacement mode 
selected from the above described mode and on the replaced 
picture) . If the transport packets TP are scrambled, they 
shall be denoted in clear by setting the control field of the 
transport scrambling control TSC at the binary value 00; note 
should be taken that the access control messages ECM (rights 
control messages) containing the cryptograms of the control 
words continue being emitted, 
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— when all replacement picture data have been inserted into 
the payloads of the video component transport packet TP, 
replacement continues by replacing the payload data with 
video stuffing (namely '00 octets) until the appearance of 
the next transport packet of this second-program video 
component of which the PUSI indicator is set at 1 (this 
transport packet TP excluded) , 

— then restarting the three preceding stages from this new 
transport packet TP with the PUSI indicator set at 1 until 
the appearance of the next transport packet TP of the second- 
program video component of which the RAI indicator is set at 
1 (excluded) , 

-- setting the discontinuity indicator DI at 1 on this packet 
fitted with the RAI indicator, corresponding to the end of 
replacement and to the effective beginning of the second 
program video . 

[091] In case the RAI indicators are absent from one or both 

transport streams, a method of the invention allows finding the sequence 
headers in the payloads of the transport packets TP at the time of 
switching. This method consists in determining during a first time 
interval the transport packet TP of the video component of the stream (s) 
lacking an RAI indicator of which PUSI indicator is set at 1 and of 
which the payload data begin with a video sequence header. 
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[092] if the video component is in clear, the search for the 

sequence header does not raise problems: if present, it will be situated 
directly after the PES packet header. if the video component is 
scrambled, the search for the sequence header entails using an 
unscrambler. 



rti 



[093] If the transport packet TP so determined comprises an 

adaptation field with a program clock reference PCR in the case when the 
component carries the program clock, it will be feasible to easily set 
the discontinuity index DI in this transport packet TP. 

[094] if said transport packet TP lacks an adaptation field AF or 

if it comprises one but lacks a clock reference PCR when the component 
carrying the program clock is involved, then a transport packet TP must 
be inserted in order to locate the discontinuity indicator DI, and, as 
called for, the clock reference PCR. 

[095] This case is shown in Fig. 10a. The upper line shows a 

transport packet TP1 of which the header H is fitted with the PUSI 
indicator set at 1 and of which the payload PL contains a sequence 
header but lacks an adaptation field AF. In this example, the packet 
identifier PID equals 100 and the discontinuity counter COMP equals an 
arbitrary value of 5 . 

[096] The inserted transport packet TPins exhibits the following 

features (lower line of Fig. 10a): 
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— the PUSI indicator is set at 0: this indicates that this 
transport packet TP lacks the beginning of a PES packet, 



— the status of the continuity counter is set at that of the 
initial transport packet f s (TP ? s) continuity counter , less 
1 (here: 5-1-4) 

— the control field AFC of the adaptation field AF is set 
at the binary value 10 denoting the presence of an adaptation 
field in this transport packet TP, but no payload, 

— the discontinuity indicator DI situated in the adaptation field 
AF is set at 1 . 

-- if the video component carries the program clock, a 
program clock reference PCR calculated after the PCR clock 
references preceding the same component is moved into the 
adaptation field AF. 

[097] The transport packet TP replaced by TP1 which is neither 

suppressed nor modified. It is phase-shifted, and so are the following 
transport packets TP of this video component in the transport stream 
until one of them can be inserted into a stuffing transport packet TP. 

[098] In case the RAI indicators are absent from one or both 

transport streams but are used in implementing switching, the invention 
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also provides pre-processing to make it possible to insert them several 
seconds before re-connection. 

[099] As stated above in relation to the MPEG-2 system standard, 

the RAI indicator is situated the adaptation field AF . Set at 1, it 
denotes that the next transport packet TP of this component which 
contains a PES packet beginning (and hence a PUSI indicator set at 1) 
will comprise a sequence header in its payload. Also, all 

synchronization data must be present in the transport packet TP of which 
the RAI indicator is set at 1, in particular a PCR clock reference if 
the component carries the program clock and the presentation time stamp 
PTS in the PES packet header. 

[100] in case a presentation stamp PTS is present in the header of 

the PES packet containing the sequence header, the transport packet TP 
inserted to set the RAI indicator exhibits the same characteristics as 
before, but the RAI indicator situated in the adaptation field AF is set 
at 1. The replaced transport packet TP is unmodified but shifted, as 
are the following transport packets TP of this video component, in the 
transport stream until one of them can be inserted into a stuffing 
transport packet TP. 

[101] This case' is illustrated in Fig. 10b. 

[102] Fig. 10c shows the case when the presentation stamp PTS is 

absent from the header of the PES packet which contains the sequence 
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header- The transport packet TP which is inserted to set the RAI 
indicator, namely TPins, exhibits the following features: 

— the PUSI indicator is set at 1: this denotes that the PES 
packet header is located in the payload, 

— the status of the continuity counter COMP is set at that 
of the continuity counter of the initial transport packet TP 
less 1 (5-1 = 4, 

— the field control AFC of the adaptation field AF is set 
at the binary value 11, denoting that an adaptation field and 
a payload are present in this packet, 

— the adaptation field AF comprises an RAI indicator set at 

— the discontinuity indicator DI is set at 1, 

— if the video component carries the program clock, a 
program clock reference PCR is situated in the adaptation 
field and is calculated based on the preceding PCR 
reference (s) of the same component, 

— a presentation stamp PTS is calculated and situated in 
this packet 1 s payload, 
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— the PES packet header which was situated in the replaced 
transport packet TP is displaced in the payload of this 
inserted transport packet TP and if the presentation stamp 
PTS is absent from the PES packet header, this PTS stamp 
shall be calculated and situated into the header data of this 
PES packet. 

[103] The replaced transport packet TP therefore is modified in a 

manner that its PUSI indicator shall be set at 1 and in that it lacks 
the PTS packet header- This transport packet TP is shifted in the 
transport stream, and so are the following transport packets TP of this 
video component, until one of them can be inserted into a stuffing 
transport packet. 

[104] It should be borne in mind that this last solution can hardly 

be considered for the case of the second program being scrambled unless 
rigorous operating rules be adopted: in case the second program were to 
share the entitlement control messages ECM linked to scrambling these 
components with other programs, said ECM messages would require a 
particular processing procedure (for instance being recreated) in order 
not to delay the other programs- 



